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Obicctivcs 

The  are  two  primary  objectives  of  this  research  effort.  The  first  is  to  develop  theory-  and 
methodology  for  neural  network  based  adaptive  control  of  uncertain  nonlinear  systems. 
The  second  is  to  work  closely  with  industry  and  government  labs  to  achieve  a  rapid 
transition  of  our  research  results  to  problems  of  high  value  to  the  Air  Force  and  to  the 
aerospace  industry. 

Status  of  Effort  ,  j  ,  .  r 

The  most  significant  theoretical  accomplishment  has  been  the  development  of  a  new 
approach  for  dealing  with  control  limits  and  nonlinearities  in  adaptive  systems.  This 
approach  both  prevents  the  adaptive  system  from  doing  harm  to  an  otherwise  stable 
system  and  also  allow-s  adaptation  to  continue  while  the  control  is  saturated.  We  regard 
this  as  ’a  major  step  towards  flight  certification  of  adaptive  controllers.  The  approach  JS 
more  general  in  that  it  permits  a  broad  class  of  input  nonlinearities,  including  such  effects 
a.s  discrete  and  bang/bang  control.  In  the  area  of  output  feedback,  we  continue  to  refine 
our  earlier  work,  and  have  begun  to  take  steps  in  the  direction  of  decentralized  adaptive 
systems  in  a  state  feedback  setting.  Our  ircci  significant  interactions  have  been  with 
NASA  Marshall  and  NASA  Ames.  In  particular,  we  ^e  fully  exploiting  our  research  in 
limited  authority  adaptive  control  in  the  areas  of  autopilot  design  for  launch  vehicles,  and 
propulsion  control  for  commercial  aircraft  subject  to  partial  or  total  loss  of  conventional 

flight  control. 


Accomplishments 

Limited  Adaptive  Control  112,  13}:  A  major  improvement  to  our  previous 

adaptive  control  work  has  been  developed  that  addresses  the  following  issues: 

•  Preventing  adaptive  windup  due  to  input  saturation  (position  and  rate) 

•  Preventing  adaptation  to  other  knowTi  input  dynamics 

•  Allowing  adaptive  control  for  mixed  continuous  and  discrete  controllers 

•  Enabling  recovery  from  faulty  adaptation 

•  Enabling  “comect”  adaptation  while  in  partial  or  no  control  of  the  plant 

The  method  has  been  termed  Pseudo-Control  Hedging  (PCH).  The  purpose  of  the 
method  is  to  prevent  the  adaptive  element  of  an  adaptive  control  system  from  trying  to 
adapt  to  a  class  of  system  input  characteristics.  To  do  this,  the  adaptive  law  is  prevented 
from  “seeing”  these  characteristics,  In  this  context,  this  means  to  prevent  an  adaptive 
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clement,  which  in  our  work  is  a  neural  network  (NN)  from  experiencing  a  system 
characteristic  as  model  tracking  error. 

In  order  to  illustrate  some  of  the  properties  of  an  implementation  of  PCH,  sanple  X-33 
fliEhl  control  system  results  will  be  described.  For  the  failure  case  illustrated  here,  it  is 
temporarily  not  possible  to  maintain  reasonable  model  tracking.  Near  maxmium 
dynamic  pressure,  half  of  the  aerodynamic  surfaces  go  hard^^ver  in  a  pro-left  turn  (right 
rudder  full  trailing  edge  right,  right  elevens  full  trdling  edge  down,  right  body  flap  full 
trailing  edge  down).  This  is  severe  enough  that  insufficient  control  power  remains  to 
maintain  the  desired  command  until  dynamic  pressure  drops.  The  vehicle  does  three  rolls 
to  the  left  before  the  dynamic  pressure  drops  enough  to  stop  the  roll,  attitude  error  angles 
shown  in  Figure  1.  The  control  system  utilizes  no  direct  knowledge/measurement  of  the 

failure. 

—  roll  pitch  ■  yaw 


time  (sec) 

Figure  1  -  Altitude  error  angles  for  X-33  Ascent,  multiple  actuator  hard-oxers  at  60 
seconds,  insufficient  control  pox/er  remains  to  maintain  desired  command  for 

approximately  60  seconds 

The  remaining  aerodynamic  surface  actuator  commands  are  showm  in  Figure  2.  During 
portions  of  this  trajectory'  the  remaining  actuators  are  at  absolute  limits;  in  other  portions 
they  are  experiencing  axis  priority  limits.  The  model  error  and  the  adaptive  signal  (NN 
output)  are  shown  in  Figure  3.  The  adaptation  signal  tracks  model  error  during  the  entire 
trajectory,  i.e,  the  NN  is  well  behaved  in  the  presence  of  considerable  actuator  saturation. 
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—  lefiFlap  — leftElevon  '^leftRudder 


Figure  2  -Actual  acluaior  positions  for  non  failed  aerodynamic  surface  actuators 


-  ModelError  AdaptiveSigna] 


time  (sec) 

Figure  3  -  Roll  model  error  and  the  adaptive  signal;  showing  correct  adaptation  for 
multiple  actuator  hard-overs  occurring  at  60  seconds 


Adaptive  Bounding  HSU  ,  ,  •  i  l  j  j  i  /cut  \  xtnJc 

Research  in  nonlinearly  parametrized  NNs,  such  as  the  single  hidden  layer  (SHL)  NNs, 

has  been  limited  to  conservative  stability  proofs  that  rely  on  the  knowledge  of  an  upper 
bound  of  the  weight  matrices.  Specifically,  in  on-line  adaptive  SHL  NN  applications  the 
most  adopted  update  laws  suffer  from  the  need  to  choose  the  gains  of  a  robusiifying  term. 
The  purpose  of  this  robustifying  term  is  to  guarantee  stability  by  overbounding  tlie 
neglected  and  higher  order  terms  in  the  Taylor  scries  expansion  of  the  NN  output.  The 
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expansion  is  necessar>'  in  order  to  obtain  implementable  adaptive  update  laws. 
Experience  has  shown  that  this  choice  is  not  straightforward,  as  this  term  has  the 
structure  of  a  pure  feedback  term.  Choosing  a  conservatively  high  gain  causes  a  situation 
in  which  the  adaptive  NN  signal  does  not  appear  to  play  any  role. 

A  less  conservative  approach  is  to  introduce  an  adaptive  bound.  By  analyzing  the  higher 
r-der  terms  of  the  NN  output,  it  is  possible  to  derive  a  bound  that  is  explicitly  a  function 
of  known  signals.  The  higher  order  terms  can  thus  be  overbounded  by  the  product  of  an 
unknow-n  gain  and  the  known  function.  Boundedness  of  signals  can  be  guaranteed  by 
introducing  an  additional  adaptive  law  that  estimates  the  unknown  gain.  As  a  result, 
instead  of  having  to  guess  the  upper  bound  on  the  weight  matrices  and  a  feedback  gain,  it 
is  necessary  to  choose  the  adaptation  gain  and  the  e-modification  gain.  This  alternative 
approach  is  easier  to  implement,  because  in  practice  it  is  easier  to  adjust  adaptation  gains 
than  guessing  feedback  gains  and  upper  bounds  to  the  ideal  weights. 


We  have  explicitly  extended  the  use  of  the  adaptive  bound  to  Radial  Basis  Function 
(RBF)  and  SHL  NNs.  In  RBF  NNs  the  outer  layer  weights  as  well  as  the  centers  and 
widths  of  the  neurons  are  adapted  on-line. 

D^r^fitralhed  rontrol  desiptt:  We  have  developed  adaptive  decentralized  state  feedback 
control  architecture  for  large-scale  systems  with  interconnections  being  bounded  by 
unknown  nonlinear  functions  of  tracking  errors.  The  local  subsystems  are  considered  to 
be  feedback  linearizable.  The  learning  rules  for  adaptive  siiigle  Wdden  layer  neural 
network  controllers  are  backpropagation  with  e-modification,  including  adaptive 
bounding  on  the  neglected  higher  order  terms  of  the  neural  network  Taylor  series 
expansion,  and  on  the  interconnection  functions.  Sufficient  conditions  are  derived  for 
uniform  ultimate  boundedness  of  the  tracking  errors.  Future  research  in  this  direction 
will  attempt  to  extend  these  results  to  the  output  feedback  case. 


Personnel  Supported 

Faculty:  Calise,  A.J.,  Professor. 

VishinG  Scholar:  Hovakimyan,  N.,  Ph.D.  in  Physics  and  Mathematics  from  the  Moscow 
Institute  of  Applied  Mathematics. 

Stiidenl.s:  Nardi,  F.,  graduate  research  assist^t 

Johnson,  E.,  graduate  research  assistant 

Interaclions/Transitions 

Conferences:  ACC,  AIAA  GN&C,  CDC  (see  reference  list) 

Civil  Transportation  HOI:  We  have  a  cooperative  effort  with  NASA  Ames  in  the  area  of 
flight  safety.  During  this  past  year  we  delivered  a 
NN  based  real  time  flight  control  system  design,  and 
integrated  into  their  piloted  simulation  facility.  It  has 
undergone  preliminary  piloted  evaluations.  This 
approach  uses  a  propulsion  control  mode  to  assist  in 
controlling  the  aircraft  when  there  is  a  failure  in  the 
primary  flight  control  system.  We  are  currently  in 
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the  process  of  incorporating  our  pseudo-control  hedging  approach  to  accommodate  the 
control  limits  that  are  encountered  in  these  applications. 

Launch  Vehicles  1121:  Wc  are  working  with  NASA  Marshall  to  design  an  adaptive  autopilot 
for  the  X-33  vehicle.  This  vehicle  routinely  flys  with  one  or  more  of  its  actuators  saturated  over 
portions  of  its  envelope.  Also,  the  flight  control  system  must  accommodate  a  number  of  abort 
scenarios.  Also,  the  ac.iation  suite  consists  of  a  combination  of  both  continuous  control 
(variations  in  thrust  magnitude)  and  discrete  controllers  (reaction  control  system).  Therefore  our 
adaptive  design  must  allow  for  both  position  and  rate 
saturation,  and  nonlinear  controller  effects  due  to  the 
reaction  control  system.  The  existing  design  is  gain 
scheduled  with  both  flight  condition  and  a  family  of 
abort  scenarios.  But  all  possible  failures  arc  not 
considered.  Moreover  the  design  is  highly  sensitive 
to  changes  in  vehicle  design,  so  that  when  a  change  is 
made,  in  many  cases  it  is  not  possible  to  run  the 
simulation  without  redesigning  the  gain  tables.  Our 
system  has  completely  eliminated  the  need  for  gain 

tables.  It  makes  no  use  of  the  aerodynamic  data  set,  ^ 

and  out-performs  the  existing  gain  scheduled  design.  We  have  also  successfully  flown  severe 
failure  conditions  in  which  the  controls  are  saturated  for  long  periods  of  time  that  fte  present 
flight  control  system  can  not  tolerate.  This  is  a  natural  application  for  our  research  m  pseudo- 
control  hedging,  and  we  expect  that  in  the  future  this  effort  will  result  in  a  major  technology 
transition  success. 


Guided  Munitions  IllJ:  We  are  currently  supporting  a  Ph^e-II  SBIR  effort  wth  Guided 
Systems  Technologies,  This  work  is  aimed  at  demonstrating  that  a  single  tail  kit  with  a 
fixed  autopilot  design  c?Ji  be  used  to  control  a  wide  class  of  guided  munitions.  Also,  the 
autopilot  design  must  accommodate 
changes  in  mission  profiles,  without 
significant  redesign.  The  design 
should  not  require  accurate 
aerodynamic  data  as  well.  This  will 
further  reduce  costs  by  reducing  the 
need  for  wind  tunnel  testing.  During 
this  past  year  we  have  demonstrated 
that  with  our  adaptive  approach  it  is 
possible  to  design  the  autopilot  using 
missile  DATCOM  data,  without  the  benefit  of  wind  tunnel  data.  Since  we  are  using 
missiles  from  the  existing  inventory,  for  which  accurate  wind  tunnel  models  exists,  we 
were  able  to  use  the  accurate  models  to  demonstrate  that  envelope  performance  is  equal 
to  or  better  than  the  existing  gain  scheduled  designs,  A  series  of  drop  tests  are  planned 
for  Phase-111. 
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